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1.  Introduction 


Remote  sensing  of  the  atmosphere  Is  a  rapidly  developing  science. 
Today's  meteorological  satellites  such  as  those  In  the  TIROS-N  series  have 
high  resolution  Instruments  on  board  which  measure  the  intensity  of 
upwelllng  radiation  in  selected  channel  frequencies.  A  description  of  the 
data  retrieved  by  the  radiometers  on  the  TIROS-N  type  satellites  can  be 
found  In  [7],  From  these  data  It  Is  possible  to  obtain  Information  on  the 
atmosphere's  temperature,  moisture  and  wind  structure.  One  of  the  goals  of 
the  current  Satellite  Meteorology  program  is  to  Improve  the  quality  of 
atmospheric  information  obtained  from  satellite  soundings  to  a  point  where 
it  can  be  used  for  weather  forecasting  purposes.  A  major  challenge  In  this 
direction  is  to  develop  refined  numerical  and  statistical  methods  for 
Inverting  the  equations  of  radiative  transfer  given  a  finite  number  of 
noisy  measurements. 

For  a  non-scattering  atmosphere  in  local  thermodynamic  equilibrium  the 
radiative  transfer  equations  (RTF's)  describe  how  the  satellite  upwelllng 
radiance  measurements  relate  to  the  underlying  temperature  distribution  T:- 


.  p°  d 

3v(T)  *  Bv[T(P0)]tv(p0)  -  /  BvCT(p)^v(p)dp 


(1.1) 


where  pQ  Is  the  surface  pressure,  -^(p)  Is  the  transmittance  of  the 

atmosphere  above  pressure  p  at  frequency  v,  and  B  Is  Plank* s_functj< 

rjJoieU"  7#r 

V  TrtiS 

i2L!£»b 


given  by:- 


r 

i 

r 
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(1.2) 


Bv[T(p)]  =  clV3/{exp(c2v/T(p))  -  1} 

-5  2 

c^  *  1.19061X10  erg-cm  -sec 
c2  *  1.43868  cm-deg(K) 

The  R.T.E's  are  of  course  an  Idealization.  They  describe  the  inten¬ 
sities  the  satellite  radiometer  would  record  in  the  absence  of  such  things 
as  atmospheric  attenuation  due  to  clouds  or  Instrument  noise.  However, 
by  using  high  resolution  radiometers  like  the  HIRS  or  AVHRR,  sets  of 
intensity  measurements  from  many  F0V‘s  (fields  of  vision)  can  be  combined 
to  obtain  data  of  the  form 

21  =  +  ei  *  =  !.•••» n  (1.3) 

where  e^'s  are  errors.  These  data  relate  to  an  area  of  about  119  by  140  km 
on  the  earth's  surface.  See  [6]  for  more  details. 

We  are  Interested  In  refining  the  methods  used  to  obtain  temperature 
distribution  estimates  from  the  above  data.  The  procedure  currently  used 
to  process  TIROS-N  temperature  sounding  data  Is  a  linear  regression 
technique  see  [6].  Here  we  begin  to  discuss  how  the  method  of  regulariza¬ 
tion  (M.O.R. )  might  be  used  to  Improve  the  quality  of  temperature  profiles 
obtainable  by  this  procedure. 
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Let  T  be  the  true  temperature  profile  In  the  atmosphere.  Then  T  can  be 
written  as 

T  -  Tq  +  6  (1.4) 

where  TQ  is  the  current  best  guess  of  T  and  4  is  the  update  or  correction 
to  T0  to  be  estimated  from  the  data  {z^}  in  hand.  Using  M.O.R.  to  estimate 
6  involves  consideration  of  a  functional  1^  given  by 

1,(4)  -  I  [zrl(V«)]2  +  X  /°[5(m)(p)]2dp  (1.5) 

a  ia1  i  -v  u  0 

and  picking  the  estimated  update  4^  to  minimize  this  functional’  over  some 
class  of  physically  plausible  candidates,  for  instance  the  set  of  functions 
«  in  W2m[0,p0]  for  which  TQ+4  is  positive  or  perhaps,  if  the  location 
of  the  temperature  inversion  were  reliably  known,  one  would  look  for  mini- 
mizers  of  1^  subject  to  an  additional  constraint  involving  temperature 
inversion. 

The  statistical  reasoning  for  considering  regularized  estimates  of  this 
type  is  well  documented  in  the  literature,  see  for  example  [3]  and  [1]. 
Intuitively  4X  has  been  designed  to  match  the  observed  data  and  possess 
certain  smoothness  qualities.  The  parameter  x  controls  a  tradeoff  between 


the  smoothness  of  a  solution  (measured  by 


/  [4  ^(p)]2dp)  and  how  well  it 
0 


—  2 
Cl]  This  corresponds  to  the  case  when  the  measurement  errors  are  iid  N(0,o  ). 

A  more  "robust"  method  would  be  to  consider  functionals  of  the  form 
n  Pq 

!,<«>  -  ?  p[zr  1  (Tn+4)]  +  x  /  C«(m)(p)]2dp 
*  i-1  1  ^i  0  0 

where  o  reflected  the  possible  non-Gausslan  nature  of  the  noise. 
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matches  the  data  {the  £  [z,,-  $  (TA+6  )]2  term). 

1*1  1  M  0  x 

Inverting  the  R.T.E.'s  with  noisy  data  can  be  viewed  as  a  special  case 
of  a  more  general  situation  In  which  the  scientist  wishes  to  estimate  a 
function  x  given  data 

Zj  *  Njfx)  +  e1  1  =  1 . n  (1.6) 

where  x  Is  In  some  Hilbert  space  H,  the  N^'s  are  non-linear  functionals 
and  e^'s  are  noise.  Here,  assuming  the  e^'s  are  lid  N(0,o2),  3n 
appropriate  regularization  function  1^  Is 

n  2 

I,(x)  *  l  Cz.-Njx)]  +  xj(x)  (1.7) 

x  1«1  1  1 

where  J  Is  a  roughness  penalty  functional  on  H.  To  estimate  x  one  proceeds 
to  minimize  IA  over  some  subset  of  physical  interest  in  H.  This  report 
summarizes  recent  results  we  have  obtained  on  the  existence  and  numerical 
approxlmabllity  of  mlnlmlzers  of  such  lA's  in  certain  subsets  of  H.  We 
indicate  how  these  results  apply  to  the  radiative  transfer  equations  case. 

There  are  three  sections:  section  2  talks  about  the  existence  theory; 
a  Gauss-Newton  algorithm  for  minimizing  the  regularization  functionals  Is 
outlined  In  section  3,  while  the  final  section  briefly  describes  how  to 
estimate  the  smoothing  parameter  using  a  first  order  approximation  to  the 
generalized  cross  validation  function  given  In  [8].  We  assume  the  reader 
Is  familiar  with  the  basic  mathematical  tools  for  discussing  minimization 
problems  In  Hilbert  spaces.  Part  1  of  Ekeland  and  Temam's  book  T2]  Is  an 
Inspiring  Introduction  to  this  subject. 
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2.  Existence  Theory 
Prel iminaries 

Before  describing  our  main  results,  let's  pause  a  moment  to  get  our 
notation  straight.  H  is  a  real  Hilbert  space  with  inner  product  <*,*>  and 
norm  ||*||  (so  <x,x>» | |x| |2 ).  P  is  a  projection  operator  in  H  with  finite 
dimentional  null  space;  toe  complementary  projection  I-P  is  denoted  by  PQ- 
H*  is  the  dual  space  of  H,  i.e.  toe  space  of  all  continuous  linear  maps 
from  H  Into  R.  L(H,H*)  is  toe  space  of  linear  operators  from  H  Into  H*. 

We  will  discuss  functionals,  I  say,  acting  on  H  (so  I:  H*R).  The  first  and 
second  Frechet  derivatives  of  I  at  some  point  xeH  will  be  denoted  by  I'(x) 
and  I"(x)  respectively.  Think  of  l'(x)  as  an  element  of  H*  and  I"(x)  as 
an  element  of  L(H,H*) .  Our  concern  here  is  with  regularization  functionals 
on  H  given  by 


I«(x)  *  t  [zrN,(x)J2  +  AllPxll2  (2.1) 

where  N^'s  are  functionals  on  H,  Zj's  are  InR,  xcH  and  *>0.  Whenever  we 
write  Ix  the  form  (2.1)  will  be  what  is  meant.  So  we  are  considering  regu¬ 
larization  procedures  In  which  the  roughness  penalty  J(x)  Is  a  semi-norm  on 
H  given  by  J(x)  -  ||Px||2. 

Mein  Results 

We  now  specify  conditions  on  the  non-linear  functionals  which 
guarantee  the  existence  of  mlnlmlzers  of  1^  In  closed  convex  subsets  K  of 
H.  In  the  R.T.E.  case  a  reasonable  choice  for  K  Is  the  set  of  all  func¬ 
tions  In  Wj^O, Pq3  for  which  TQ+«  Is  positive.  It  Is  very  easy  to  check 
that  this  K  Is  a  closed  convex  subset  of  W^”[o,p0]  for  any  n.  Our 
existence  results  are  summarized  In  the  following  three  theorems. 


Theorem  1  {proof  in  [2]  pp.  34-35). 

Let  K  be  a  closed  convex  subset  of  a  Hilbert  space  H.  Suppose  1^:  K+R  is 
coercive  on  K  (i.e.  I.  (x)t»  as  ||x||+«  in  K)  and  moreover  that  I  is  weakly 

A  A 

lower  semi-continuous  (w.l.s.c.)  on  K  then  I.  attains  its  infimum  on  K. 

A  ' 

Theorem  2  {proof  in  [4]) 

Let  +  :  R-*-R  be  a  monotonic  increasing  function  in  the  modulus  of  its  argu¬ 
ment.  Suppose 
n 

{1)  l  ♦(N4(x))  Is  convex  on  K 
1=1  1 

n 

(ill  l  4>CN1(x)]  ■  4<*>  PQx  =  PQe  for  some  e  In  K 
then  Ix  is  coercive  on  K. 

Remark:  The  above  theorem  can  be  generalized  somewhat  but  we  refrain  from 
doing  so  because  the  form  given  has  more  Intuitive  appeal. 

Theorem  3 

If  Nf  Is  weakly  continuous  (w.c.)  on  K  for  each  i  then  1^  Is  w.l.s.c.  on  K. 

n  , 

Proof:  If  the  MJ  are  w.c.,  then  It  surely  follows  that  7  [z.-N.(x)]  is 
1  1=1  1  1 
2 

w.c.  But  llPxll  Is  well  known  to  be  w.l.s.c.  Therefore  1^  Is 
w.l.s.c.  QED 
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Application  to  the  R.T.E.'s  (see  [4]  for  details) 

The  arising  here  can  be  shown  to  satisfy  the  hypotheses  of  Theorem  2 
with  *  taken  to  be 

♦  (x)  *  |x|,  xeR 

Also,  each  Is  w.c.  We  therefore  have  that  for  each 
*>0,3  6xcK  *  {«cW2mto,p0l  T0+6>0},  s.t. 

1.(6.)  -  min  {J  Czrl,  <V4^2  +  x/°C«(m)(P)32dp} 

*  A  6cK  1-1  1  M  0  6 

There  exist  regularized  solutions  to  the  R.T.E.'s. 

3.  A  numerical  procedure  for  minimizing  Ix  In  K 


k  th 

Let  x  be  the  k  approximation  to  the  mlnlmlzer  In  K  of  1^.  Define 

k 

the  functional  Ix  on  K  as  follows 


I  k(x)  -  l  CzrN.(xk)-Ni(xk)[x-xk]]2  +  XllPxll2  (3.1) 

*  1-1  1  1  1 

each  M1  Is  simply  linearized  about  xk.  Define  xk+1  to  be  the  mlnlmlzer  in 

K  of  lxk. 

|[ 

Under  suitable  regularity  conditions  the  Iterates  x  are  well  defined 
and  can  be  shown  to  satisfy 

xk+1  •  xk  -  {  l  Mi(xk)Ni(xk)  ♦  x<P.,.>}"1I'  (xk) 

1-1  1  1  * 

s  xk  -  A‘1(xk)I,(xk) 


(3.2) 


Ic 

That  this  equation  makes  good  sense  Is  evident  once  one  realizes  that  A(x  ) 
belongs  to  L(H,H*)  and  ^‘(x*)  is  In  H*. 

Those  In  the  know  will  have  recognized  that  the  above  procedure  Is 
nothing  more  than  an  Infinite  dimensional  version  of  the  Gauss-Newton 
algorithm.  The  finite  dlmentlonal  case  Is  discussed  In  [5].  The  major 
advantage  of  using  a  Gauss-Newton  procedure  to  minimize  our  regularization 
functionals  Is  the  ease  with  which  successive  Interates  can  be  obtained. 

At  each  stage  we  have  a  regularization  problem  Involving  linear  func- 
tlonals,  the  N.'(x  )'s,  consequently  we  can  take  advantage  of  available 
software  tools. 

With  the  appropriate  assumptions  It  Is  possible  to  show  that  the  proce- 

k 

dure  is  a  decent  method  and  the  sequence  x  converges  at  least  R-linearly 
to  a  critical  point  of  Ix  In  K. 

Theorem  4  (proof  In  [4]). 

Suppose  that  the  N^(-)‘s  are  twice  continuously  differentiable  and 
N1 ' ( . ) * s  are  w.c.  on  Int  K.  Let  x°e  Int  K  be  such  that 

L°  ■  {xll^tx)  <  Ix(x°)} 

Is  weakly  compact  and  lx  has  only  finitely  many  critical  points  In  L°  . 
Moreover,  suppose  that  Uq^iTj  all  positive  with  satisfying 

w0llh||2  <  <h,A(x)h>  <  u-|  llh|  |2  ,  Ix"(x)hh  <  !  Ih|  |2  VxeL°,  heH 

then  the  sequence  of  iterates  {x*}t  L°,  11m  xk  *  x*  where  I. '(x*)  =  o  and 

k 

If  Ix"(x  )  Is  non-singular,  then  the  convergence  Is  at  least  R-l Inear. 

The  proof  follows  an  argument  similar  to  that  used  In  14.4.6  of  [5]. 


4.  The  choice  of  X 


The  generalized  cross  validation  method  for  choosing  x  works  as  follows. 
Let  x;^  be  the  minimized  In  K  of 


l  Czj-M.(x)]2  +  x|  |Px  1 12 
1-1  '  1 


Then  X  Is  chosen  to  minimize 


where  ^(x^*-1)  Is  the  prediction  of  zfe  given  the  data  z1 ,z2>. . . ,zk  ^ 
Zi,. , « •  .z  and  a  *(x)  Is  the  "differential  Influence"  of  the  z  'th  data 

K+l  n  KK  K 

point  on  the  estimate  xx  (x^  Is  the  minimlzer  in  K  of  Ix). 


\k*<*> 


Wk(xx[k])-Wk(xx) 

Mk(xxCk3,-zk 


From  a  computational  viewpoint  V(X)  Is  prohibitively  expensive  so  one  needs 
to  find  some  convenient  approximation.  Following  Wahba  [8],  V(X)  can  be 


approximated  by 


ul  Assumed  to  be  uniquely  defined 


Sr-  «  A- 
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1 

J 


where  v\  given  by 


Pi  (X) 


1  ?  w 

n.  1.  az. 


k=l 


Is  an  easily  computed  functional  of  x^.  We  hope  to  study  this  procedure 
more  closely  In  the  near  future. 
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